Benchmarking Web API Quality
نویسندگان
چکیده
Web APIs are increasingly becoming an integral part of web or mobile applications. As a consequence, performance characteristics and availability of the APIs used directly impact the user experience of end users. Still, quality of web APIs is largely ignored and simply assumed to be su ciently good and stable. Especially considering geo-mobility of today’s client devices, this can lead to negative surprises at runtime. In this work, we present an approach and toolkit for benchmarking the quality of web APIs considering geo-mobility of clients. Using our benchmarking tool, we then present the surprising results of a geo-distributed 3-month benchmark run for 15 web APIs and discuss how application developers can deal with volatile quality both from an architectural and engineering point of view.
منابع مشابه
Guidelines for Benchmarking the Performance of Ontology Management APIs
Ontology tools performance and scalability are critical to both the growth of the Semantic Web and the establishment of these tools in the industry. In this paper, we present briefly the benchmarking methodology used to improve the performance and the scalability of ontology development tools. We focus on the definition of the infrastructure for evaluating the performance of these tools’ ontolo...
متن کاملBenchmarking and improving the quality of Norwegian municipality web sites
Automatic benchmarking can provide a reliable first insight into the accessibility status of a web site. The eGovMon project has developed a tool which can assess web sites according to a statistically sound sampling procedure. Additionally, the tool supports detailed evaluation of single web pages. This paper describes the process of data acquisition for the case of large scale accessibility b...
متن کاملAn Evaluation of Open-Source Soware Microbenchmark Suites for Continuous Performance Assessment
Continuous integration (CI) emphasizes quick feedback to developers. This is at odds with current practice of performance testing, which predominantely focuses on long-running tests against entire systems in production-like environments. Alternatively, software microbenchmarking attempts to establish a performance baseline for small code fragments in short time. This paper investigates the qual...
متن کاملUsing the RxNorm Web Services API for Quality Assurance Purposes
Auditing large, rapidly evolving terminological systems is still a challenge. In the case of RxNorm, a standardized nomenclature for clinical drugs, we argue that quality assurance processes can benefit from the recently released application programming interface (API) provided by RxNav. We demonstrate the usefulness of the API by performing a systematic comparison of alternative paths in the R...
متن کاملBenchmarking in the Semantic Web
The Semantic Web technology needs to be thoroughly evaluated for providing objective results and obtaining massive improvement in its quality; thus, the transfer of this technology from research to industry will speed up. This chapter presents software benchmarking, a process that aims to improve the Semantic Web technology and to find the best practices. The chapter also describes a specific s...
متن کامل